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Reliability and Validity of the Child and Adolescent 
Functioning Impairment Scale in Children 
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Objective The purpose of the present study was to develop reliable and valid parent and teacher scales for measurement of functional 
impairment in children and adolescents in order to assist the diagnosis of attention-deficit/hyperactivity disorder (ADHD). 

Methods Seventy-two children with ADHD fulfilling the Diagnostic and Statistical Manual of Mental Disorder, 4th Edition criteria 
and forty-two normal controls were enrolled in this study. Parents and teachers of the subjects completed the parent and teacher form of 
the preliminary items of Child and Adolescent Functioning Impairment Scale (CAFIS) made up by the authors. Based on the reliability 
and factor analysis, the final parent (CAFIS-parent form) and teacher version (CAFIS-teacher form) were constructed. Scales were ana- 
lyzed for reliability and validity. Relative operating characteristics curve was drawn to calculate the cutoff scores of these scales for chil- 
dren with ADHD. 

Results The CAFIS-parent and CAFIS-teacher forms consist of four and three factors, respectively. Internal consistency and test-retest 
correlation of the scales were satisfactory. The CAFIS and Children's Global Assessment Scale were significantly correlated. AH scores of 
subscales of CAFIS in ADHD group were significantly higher than those of control group. The sensitivity and specificity of the subscales 
were mostly at an appropriate level. 

Conclusion The CAFIS is a brief layperson-administered scale to assess functional impairment of children and adolescents. It can be 
a useful tool for parents and teachers to objectively measure the functions of children at home and in school. This scale was found to be reli- 
able and valid, and it appears to be a valuable instrument in Korean language. Psychiatry Investig 2011 ;8:113-122 
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INTRODUCTION 

Diagnostic criteria for attention-deficit/hyperactivity disor- 
der (ADHD) in the Diagnostic and Statistical Manual of Men- 
tal Disorder, 4th Edition (DSM-IV)' is consisted of two dimen- 
sions: symptoms and impairment. The 'symptom' criteria 
include three areas (i.e., inattention, hyperactivity, and impul- 
sivity) and specifies symptoms related to each area (e.g., often 
has difficulty organizing tasks and activities). However, the 
'impairment' criteria do not provide a specific guideline, but 
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describes simply that "there must be clear evidence of clinically 
significant impairment in social, academic, or occupational 
functioning)'! The nebulous description of the definition of im- 
pairment in DSM-IV creates difficulties in assessing functional 
impairment of children, and therefore in the diagnostic proce- 
dures of ADHD. 

The relationships between symptoms and impairment of a 
disorder need to be delineated. Some clinicians or researchers 
make diagnostic decisions predominantly based on the num- 
ber and intensity of the symptoms reported, but not on the 
fimctional impairment. The assumption is that symptoms and 
impairments are closely associated to each other. Alternatively 
researchers and clinicians build the notion of impairment into 
their symptom rating. That is, one does not rate someone as 
"unable to concentrate" unless the patient is impaired by the 
symptom or behavior. However, there is a growing body of ev- 
idence suggesting that symptoms and impairment are certain- 
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ly not identical, but are at best moderately related?'' In the ear- 
ly field trial, the number of children meeting criteria for 
psychiatric diagnosis fell dramatically when impairment mea- 
sures were considered.'''' Thus, overlooking impairment in the 
diagnosis of ADHD would lead to false positive diagnoses and 
increase of the prevalence. On the other hand, overemphasiz- 
ing impairment can lead to false negative diagnoses and de- 
crease of the prevalence. Some children have significant func- 
tional impairment yet do not meet the symptom criteria for 
psychiatric diagnoses.*"'^ Specifically, Angold et al.*" reported 
that 40% of children who used specialty mental health servic- 
es did not meet symptom criteria, but did have fiinctional im- 
pairment. Clinical service use was concentrated in families 
who had a youth evidencing impairment whether or not the 
child met symptom criteria. More specifically, parents or teach- 
ers rarely complain about impairment associated with the 
problems related to ADHD symptoms such as 'often does not 
seem to listen when spoken to directly' or often talks exces- 
sively'. Rather they reported that the child was rejected by 
peers, failed academic classes in school, or disrupted family 
and classroom functioning. In other words, use of clinical ser- 
■vices is usually precipitated by impairment, not by symptoms.* 
Furthermore, impairment in fiinctioning during childhood is 
one of the best predictors of negative long-term outcomes.* 
For example, poor peer relationships and academic under- 
achievement in childhood predict poor outcomes in adult- 
hood.'''" As it is well known that ADHD with it's profound im- 
pairment in many fiinctional areas can persist throughout the 
adulthood," improvement in impairment domains must be 
achieved to avoid continued problems throughout the devel- 
opment. Therefore, it is critical to include impairment not only 
in diagnostic decision making, but also in treatment planning 
and in prediction of outcome in adulthood. Given all that, we 
concluded that symptoms and impairment are related, but 
likely have distinct correlates and importance in diagnosis and 
assessment. Therefore, impairment should be measured inde- 
pendently in addition to the symptoms to determine the pres- 
ence of ADHD. 

For assessing functional impairment in children and adoles- 
cents, there exist three types of rating scales: global impair- 
ment scales, domain-specific scales, and symptom- specific 
scales. The global impairment scale enable the interviewer to 
rate a child on a single scale of functioning. The ChUdreris 
Global Assessment Scale (C-GAS),'^ the representative scale 
for a global impairment provides a single global rating of func- 
tioning. The advantage of this scales is that it is very brief and 
can easily be administered to children and adolescents allow- 
ing comparison of functional impairment between groups of 
patients with different diagnoses."'" However, C-GAS is not an 
independent measure of impairment and is strongly associat- 



ed with psychiatric symptoms." In addition, global scales fail 
to provide information about the most impaired domains of 
functioning thereby compromising the most suitable targets for 
treatment planning.'*" 

By contrast, domain-specific impairment scales provide sep- 
arate scores for each domain of functioning. The Child and 
Adolescent Functional Assessment Scale (CAFAS)," The Brief 
Impairment Scale (BIS),'" and Ontario Child Health Study 
(OCHS) scale," are representative of domain-specific scales. 
The CAFAS'^ is the most widely used domain-specific impair- 
ment scale. It can be administered during a clinician-adminis- 
tered interview and contains 5 subscale domains pertaining to 
the child's fiinctioning and 2 to the child's caregivers to assess 
the degree of impairment associated with emotional, behav- 
ioral, or substance abuse problems of children. The youth sub- 
scales include Role Performance (how effectively the youth 
fulfills societal roles in school, home and community). Behav- 
ior Toward Self and Others (appropriateness of the youth's dai- 
ly behavior). Thinking (ability to use rational thought process- 
es), Moods/Emotions (modulation of the youth's emotional 
Ufe), and Substance Abuse (extent of use and degree to which 
it is disruptive). The caregiver subscales include Basic Needs 
(caregiver ability to provide for the child's basic needs) and 
Family/Social Support (the degree to which the relationship 
and nurturance provided by the caregiver meets the child's 
needs). The BIS'* to be administered by an adult informant, 
covers three domains: Interpersonal Relations, School/Work; 
and Self-Fulfillment. The OCHS" scale provides measures of 
function that assess social, behavioural, and academic impair- 
ment of children. It includes child's social participation, quali- 
ty of the child's social relationships, school participation and 
achievement, global child/youth functioning, family activities, 
family conflict and anxiety, and global family situation. These 
scales provide information about impairment in several spe- 
cific areas of functioning and permit precise assessment of ar- 
eas necessary to planning intervention or prevention. Howev- 
er, the items in these domain-specific scales are not tied 
specifically to psychiatric symptoms. In other words, the mea- 
sure of functional impairment indicated in domain-specific 
scales is not necessarily caused by the symptoms reported. 
Domain-specific impairment scales are inappropriate for use 
as diagnostic measures because they are not linked to specific 
diagnostic symptoms of psychiatric disorders. 

By contrast, symptom- specific impairment scales measure 
the degree of disability associated with a specific symptom or 
diagnosis. Diagnostic Interview Schedule for Children, Version 
IV (DISC-IV)^° Impairment measures and Child and Adoles- 
cent Psychiatric Assessment (CAPA)^' incapacity ratings are 
the representatives of symptom-specific scales. Like the do- 
main-specific impairment scales, these scales assess various 
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domains of functioning. For example, the DISC-IV contains 6 
questions probing how often the caregiver and teacher be- 
comes upset with the child and how often the child has prob- 
lems doing things with the family, doing things with other 
children, doing homework or grades, or feeling badly or upset. 
Since these scales measure functional impairment due to one's 
psychiatric symptoms reported and include all areas associat- 
ed with functional impairment of in DSM-IV, they are usefiil 
for the diagnostic purpose of child's psychiatric disorders. 
Each measurement have their own weakness and strength in 
assessment of functional impairment in children. 

Taken altogether, there exist following reasons for conduct- 
ing our study. First, so far, there is no common operationaUza- 
tion of measuring impairment in children. The lack of the gold 
standard in measuring impairment applies to ADHD as well, 
though it is one of the most commonly diagnosed childhood 
disorders nowadays. Among the above mentioned types of 
rating scales, symptom-specific impairment scale would be the 
most appropriate instrument for diagnostic purposes. Howev- 
er, for most symptom-specific scales, the construct validity of 
the functional domains is not clearly verified yet, because fac- 
tor analyses of the items in the scales were not performed. Ac- 
cording to our survey, there is a scarcity of studies on the diag- 
nostic purpose of the individual impairment rating scales. 
Thus, we first wanted to develop a reliable and valid scale mea- 
suring the social and academic functional impairment of chil- 
dren with ADHD. Second, impairment in functioning at home 
and in school settings needs to be assessed objectively based 
on the respondent-based format. Thus, we wanted to develop 
a separate rating scale for parents and teachers to assess im- 
pairment of functioning of children in two different situations. 
And at last, we wanted to draw an optimal cutoff score of the 
developing scales for distinguishing functional impairment 
between children with ADHD and normal children. This may 
serve as an impairment-based criterion for ADHD. 

METHODS 

Participants and procedures 

Preliminary items for Child and Adolescent Functioning 
Impairment Scale (CAFIS), a self-administered rating scale for 
measurement of functional impairment in children and ado- 
lescents in Korean language, were based on the review of the 
previously well-known scales described below. An expert 
committee reviewed the items collected, and obtained 25 pre- 
liminary items for parent form and 20 preliminary items for 
teacher form of CAFIS. 

Subjects enrolled in this study were children or adolescents 
of aged 6 to 14 who visited the department of psychiatry at 
Soonchunhyang University Bucheon Hospital for assessment 



of inattention, hyperactivity and impulsivity. Exclusion criteria 
for the study were as follows: pervasive developmental disor- 
der, psychosis, bipolar disorder, past history with special edu- 
cation or brain injury, a sensory deficit, or fuU scale IQ below 
80. The mean IQ, measured by the K-WISC-IIP' of ADHD 
and normal group were 98.1 (SD=11.9) and 102.9 (SD=15.1), 
respectively. There was no significant difference in the mean 
scores of IQ between the two groups. 

For the psychiatric diagnosis of the subjects, certified clini- 
cal psychologists interviewed the children and their parents 
using the Korean schedule for affective disorders and schizo- 
phrenia for school-age children present and lifetime version 
(K-SADS-PL).'' Children in ADHD group met the fiiU DSM- 
IV criteria for ADHD, except the criteria B. ADHD partici- 
pants were drug- naive at the time of evaluation. We did not in- 
clude the age of onset criterion because the validity of age of 
onset criterion has been questioned.^'' At the diagnostic inter- 
view, the interviewer also rated the children's global function- 
ing using the C-GAS in order to investigate the concurrent va- 
lidity of CAFIS. 

Children for the control group are recruited by advertise- 
ment. They did not met DSM-IV criteria for any psychiatric 
disorders on the interview using the K-SADS-PL. Particularly, 
the children in the control group had no more than two inat- 
tentive or hyperactivity/impulsivity symptoms of DSM-IV cri- 
teria for ADHD. Based on Gorsuch^"^ and Hatcher^^'s recom- 
mendation, we determined that the subject to item ratio for 
exploratory factor analysis should be at least 5:1. 

Parent and teachers of children with ADHD and normal 
groups completed the preliminary items for CAFIS-parent 
form and CAFIS-teacher form, respectively. Based on the re- 
sults of reliability and factor analysis, items that have corrected 
item-total correlation coefficients lower than 0.2 and factor 
loadings lower than 0.4 were removed from preliminary items 
for CAFIS-parent and CAFIS-teacher forms. As a result, we 
obtained 14 items for the parent version of CAFIS and 10 items 
for teacher version of CAFIS. Thereafter, we performed the re- 
liability, validity, and relative operating characteristics (ROC) 
analysis of the CAFIS-parent and CAFIS-teacher forms. 

Internal consistency was analyzed for results of CAFIS-par- 
ent and CAFIS-teacher forms. Parents and teachers were asked 
to complete the rating scales a second time at 4 weeks later for 
analysis of test-retest reliability. Four weeks was considered to 
be a reasonable time for regarding stability in response and 
minimizing individuals' memory effect. Construct, concurrent 
and discriminant validity were analyzed for results of CAFIS- 
parent and CAFIS-teacher forms. In addition, ROC analyses 
were employed to calculate the sensitivity and specificity and 
determine the optimal cut-off point of the total and subscale 
scores of the CAFIS-parent and CAFIS-teacher forms. 
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This study protocol was approved by the Institutional Re- 
view Board of Soonchunhyang University Bucheon Hospital 
and the subjects' parents and teachers were thoroughly briefed 
in the design of the study, allowed to read and sign a written 
consent form before participating. 

Measures 

Korean schedule for affective disorders and schizophre- 
nia for school-age children present and lifetime version 

The K-SADS-PL was developed to assess the severity of 
symptoms as well as the present and lifetime status of 32 DSM- 
IV child and adolescent psychiatric disorders. It was designed 
for interviewing both the parents and the children and pro- 
vides a standardized method of obtaining and recording 
symptoms necessary for the assessment of most Axis I catego- 
ries. In the Korean version of K-SADS-PL (K-SADS-PL-K),'' 
the consensual validity of threshold diagnoses were good to ex- 
cellent (Kappa=0.70) and inter-rater (Kappa=0.42) and test- 
retest reliabilities (r=0.76) were fair to excellent for ADHD. In 
this study, board certified clinical psychologist with experience 
in child and adolescent psychiatry interviewed the subjects 
and the parents. Interviewers rated patients' symptoms with- 
out recourse to impairment. 

Child and Adolescent Functioning Impairment Scale 

At first, we collected the items of widely used, validated 
scales measuring impairment of children and adolescents. In- 
cluded scales were Impairment measures of DISC-IV, CAFAS, 
BIS, and OCHS. In addition to the aforementioned scales such 
as DISC-IV, CAFAS, BIS, and OCHS, examples of fiinctional 
impairment in children and adolescents visiting our outpatient 
clinic were collected using a questiormaire with open questions, 
for example "Do your child have any problems at home?" All 
items assembled were reviewed by an Expert Committee con- 
sisting of Korean child and adolescent psychiatrists, bilingual 
child psychiatrist, and child and adolescent clinical psycholo- 
gists. Items overlapping in meaning were deleted, and the pre- 
liminary items were selected and modified appropriately for 
our language and culture. The preliminary items for parent ver- 
sion of CAFIS was composed of 25 questions asking parents 
for functioning of children at home, and the preliminary items 
for teacher version of CAFIS of was composed of 20 questions 
asking teachers for functioning of children in school. The 
questions ask how much the problems of child aifect various 
fimctioning of daily activities due to current symptoms. In this 
study, the current symptoms were defined specifically as inat- 
tentive, hyperactive or impulsive symptoms of the individual 
subjects. The responder is asked to select one from a five-point 
scale ranging from 0 (no impairment) to 4 (severe impairment) 



for each question. Ratings reflect the most severe level of dys- 
function within the one month. 

Among the preliminary items of CAFIS-parent and CAFIS- 
teacher forms, 1 1 items of CAFIS-parent form and 10 items of 
CAFIS-teacher forms that had lower than 0.2 corrected item- 
total correlation coefficients or lower than 0.4 factor loadings 
were eliminated. As a result, CAFIS-parent form consisting of 
14 items had four following factors: 1) family relationship; 2) 
teacher relationship; 3) peer relationship; 4) academic achieve- 
ment. The CAFIS-teacher form consisting of 10 items had three 
following factors: 1) peer relationship; 2) teacher relationship; 
and, 3) academic achievement. To summarize, the CAFIS-par- 
ent and CAFIS-teacher forms included inquiries about social 
and school functioning of children and adolescents at home 
and in school. 

More specifically, the social functioning items enquire about 
the quality of the relationship of the child with family, teacher, 
and peers. For example, the items asking about family relation- 
ships consist of questions addressing problems with parents, 
siblings or other important members of the family. Whether 
treatment is needed due to the problems in relationship with 
the family members is also addressed. Problems with the 
teachers are asked in the same way. Items addressing the peer 
relationships consist of questions asking problems in getting 
along with friends, making new friends, rejected by friends 
and withdrawn or isolated by peers. Items relating to school 
functioning included problems due to low grade in school and 
the necessity of treatment due to low academic achievement. 
The CAFIS-teacher form includes items similar to the parent 
version of CAFIS except the items asking the relationship with 
the family. 

Children's Global Assessment Scale 

The C-GAS provides a global measure of level of function- 
ing in children and adolescents at home, in community and 
school, and with peers. Scores range from 1 (most impaired) 
to 100 (highest level of functiorung) to reflect the degree of 
fiinctional impairment. This scale was known to be reliable be- 
tween raters (r=0.83-92) and across time (r=0.85).'^ In this 
study, the C-GAS was rated to investigate the concurrent valid- 
ity of the CAFIS. 

Data analysis 

The CAFIS-parent and CAFIS-teacher forms were analyzed 
for their reliability, validity and diagnostic validity (ROC anal- 
ysis). To test the internal consistency, Cronbach's alpha was 
calculated on the total and subscales of the CAFIS-parent and 
teacher forms. Correlation coefficients between the first and 
second CAFIS-parent and CAFIS-teacher forms were calcu- 
lated to analyze the test-retest reUabiUty of the scales. 
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To establish the construct vahdity, an exploratory factor 
analysis was conducted (extraction method: principal axis fac- 
toring; rotation method: varimax with Kaiser normalization). 
Concurrent validity was assessed by examining the relation- 
ship between the scores on the subscales of CAFIS and C- 
GAS. To demonstrate discriminant validity, T-test was used to 
estimate the differences in the scores on the subscales of CAF- 
IS between ADHD and normal control groups. 

ROC curves were drawn to analyze the sensitivity and spec- 
ificity of CAFIS-parent and CAFIS-teacher forms, and to de- 
termine the optimal cut-off point of the CAFIS. AU analyses 
were conducted in SPSS version 14.0 (SPSS Inc., Chicago, IL, 
USA). 

RESULTS 
Participants 

One hundred fourteen children and adolescents, aged 6 to 
14 years, were involved in this research. A total of 72 children 
with ADHD (65 male, 7 female) and 42 normal children (30 
male, 12 female) were enrolled. There was significant differ- 
ence in the ratio of sex between two groups ()(^=6.79, p<0.01). 
The mean ages of ADHD and normal groups were 8.8 (SD= 
1.9) and 9.5 years (SD=2.1), respectively, and the difference in 
two groups was not significant. The comorbidities of the chil- 
dren with ADHD were shown as follows: 8 (11.1%) with tic 
disorders, 7 (9.7%) with oppositional defiant disorder, 2 (2.8%) 
with elimination disorders, 1 (1.4%) with conduct disorder, 1 
(1.4%) with obsessive-compulsive disorder and 1 (1.4%) with 
social phobia. 

Psychometric properties of CAFIS 

The CAFIS-parent form consisting of 14 items and four fac- 
tors and the CAFIS-teacher form consisting 10 items and three 
factors are shown on Table 1 and Table 2. For the four factors of 
CAFIS-parent form, the Kaiser's Measure of Sampling Ade- 
quacy (MSA)^* was 0.82 as meritorious leveF' and the variance 
explained by 4 factors were 63.72%. For the three factors of 
CAFIS-teacher form, the Kaisers MSA was 0.82 as meritorious 
level and the variance explained by 3 factors were 66.15%. 

Reliability 

The internal consistency and the test-retest reliability of 
CAFIS-parent and CAFIS-teacher forms are presented on Ta- 
ble 3. The Internal consistencies for the subscales of CAFIS- 
parent and CAFIS-teacher forms were satisfactory, Cronbachs 
alpha ranging from 0.71 to 0.90 and fi-om 0.74 to 0.90 for the 
parent and teacher form, respectively. The test-retest reliability 
coefficient of the CAFIS was found to be r=0.71 to 0.86. for the 
parent form and r=0.81 to 0.89. for the teacher form. Among 



the subscales, the correlation of the academic achievement 
subscales of CAFIS-parent and CAFIS-teacher forms were 
highest. 

Validity 

Concurrent validity 

To examine the concurrent validity of the CAFIS, correla- 
tions between the subscale scores of CAFIS-parent and CAF- 
IS-teacher forms and the C-GAS scores were calculated (Table 
4). AU subscales of CAFIS-parent and CAFIS-teacher forms 
were significantly correlated to the C-GAS score. The correla- 
tion coefficients (Pearson r) between the scores of CAFIS-par- 
ent form and the C-GAS ranged from -0.27 to -0.46 and the 
scores of CAFIS-teacher form and the C-GAS from -0.30 to 
-0.47. Correlations between the scores of the academic achi- 
evement subscales of CAFIS-parent and CAFIS-teacher forms 
and C-GAS were highest. 

Discriminant validity 

To examine the discriminant validity of the CAFIS, differ- 
ences in the mean scores of the subscales of CAFIS-parent and 
CAFIS-teacher forms between the ADHD and normal groups 
were analyzed (Table 5). All subscales of CAFIS-parent and 
CAFIS-teacher forms of the ADHD group were significantly 
higher than the control group. 

ROC analyses 

We calculated the ROC curve and the sensitivity and speci- 
ficity for the subscales of CAFIS, with the presence of ADHD 
as the gold standard. For all subscales, areas under the curve 
(AUCs), which is a measure of overall accuracy,^' were signifi- 
cant. In CAFIS-parent form, AUCs were found as follows: 0.81 
for total score (p=0.000), 0.71 for the family relationship scale 
(p=0.000), 0.71 for the teacher relationship scale (p=0.000), 
0.69 for the peer relationship (p=0.001), and 0.77 for the aca- 
demic achievement (p=0.000). In CAFIS-teacher form, AUCs 
were found as follows: 0.79 for total score (p=0.000), 0.65 for 
the teacher relationship scale (p=0.009), 0.73 for the peer rela- 
tionship (p=0.000), and 0.78 for the academic achievement 
(p=0.000). The ROC curve for total scores of CAFIS-parent 
and CAFIS-teacher form is presented in Figure 1. 

To determine the optimal cutoff scores, the sensitivity and 
specificity of different cutoff scores are calculated and present- 
ed on Table 6. 

DISCUSSION 

Clinicians and researchers tend to focus on syndrome fea- 
tures per se instead of coding patient's overall functioning or 
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Table 1 . Results of factor analyses on CAFIS-parent form 



Items 






Factor 






1 


2 




3 


4 


1 Needs treatment due to problems with parents 


0.830 


0.190 




0.202 


0.101 


2 Has problems with parents 


0.829 


0.146 




0.147 


0.038 


3 Needs treatment due to problems at home 


0.808 


0.367 




0.134 


0.150 


4 Has problems at home 


0.640 


0.059 




0.341 


0.170 


5 Needs treatment due to problems with brothers or sisters 


0.636 


0.545 




0.044 


0.072 


6 Has problems with brothers or sisters 


0.621 


0.236 




0.041 


0.077 


7 Has problems with the rest of the family 


0.572 


0.046 




0.162 


0.041 


8 Has problems with teacher 


0.247 


0.810 




0.188 


0.022 


9 Needs treatment due to problems with teacher 


0.242 


0.739 




0.193 


0.189 


10 Has problems making friends 


0.128 


0.180 




0.814 


0.050 


1 1 Has problems being rejected by friends 


0.280 


0.096 




0.725 


0.149 


12 Has problems gettmg along with friends 


0.128 


0.113 




0.625 


0.203 


13 Needs treatment due to low grade 


0.149 


0.405 




0.277 


0.775 


14 Receives low grade 


0.089 


0.017 




0.113 


0.625 


Eigenvalue 


3.82 


1.97 




1.97 


1.17 


% of variance 


27.26 


14.08 




14.04 


8.34 


CAFIS: child and adolescent functioning impairment scale 












Table 2. Results of factor analyses on CAFIS-teacher form 












Items 






Factor 






1 




2 




3 


1 Has problems getting along with friends 


0.847 




0.195 




0.210 


2 Has problems making new friends 


0.829 




0.219 




0.216 


3 Has problems being withdrawn or isolated by other people 


0.774 




0.092 




0.187 


4 Has problems being rejected by friends 


0.638 




0.224 




0.260 


5 Is not happy with his/her life 


0.604 




0.204 




0.130 


6 Needs treatment due to problems with teacher 


0.174 




0.917 




0.244 


7 Has problems with teacher 


0.212 




0.844 




0.200 


8 Refuses to attend school 


0.397 




0.444 




0.024 


9 Needs treatment due to low grade 


0.230 




0.417 




0.729 


10 Receives low grade 


0.265 




0.089 




0.723 


Eigenvalue 


3.13 




2.12 




1.37 


% of variance 


31.32 




21.18 




13.65 



CAFIS: child and adolescent functioning impairment scale 



adjustment. Though researchers have developed several im- 
pairment-specific instruments, so far, the scales have not found 
their way into routine clinical practice. This is mainly because 
the DSM-IV, the most widely used diagnostic criteria, does not 
specify the how impairment should be measured or taken into 
account in clinical practice. Some previous instruments such 
as the CAFAS are time-consuming and need training to ad- 
minister reliably. Other measures cover a narrow or too global 
range of functioning. Existing impairment measures lack of 



construct validity. 

The CAFIS is a new symptom-specific impairment scale 
that measure functional impairment independently of psychi- 
atric symptomatology in children and adolescents. This scale 
is the first one developed in this area in Korean language so 
far. It is very brief and easy to administer for layperson. Both 
parent-rated and teacher- rated versions are available, enabling 
measuring impairment in two different settings as required in 
the DSM-IV. 
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Table 3. The Internal consistency and test-retest reliability for the subscales of the CAFIS-parent and CAFIS-teacher forms 







CAFIS-parent form 






CAFIS-teacher form 






Total 


(1) (2) (3) 


(4) 


Total 


(2) (3) 


(4) 


Cronbachs a 


0.89 


0.90 0.87 0.82 


0.71 


0.88 


0.81 0.90 


0.74 


Test-retest reliability 


0.84** 


0.78** 0.71** 0.79** 


0.86** 


0.89** 


0.81** 0.86* 


0.89** 



*p<0.01, **p<0.001. (1): family relationship, (2): teacher relationship, (3): Peer relationship, (4): academic achievement, CAFIS: child and ado- 
lescent functioning impairment scale 



Table 4. Correlations between the CAFIS and C-GAS 







CAFIS-parent form 








CAFIS-teacher form 






Total 


(1) (2) 


(3) 


(4) 


Total 


(2) (3) 


(4) 


C-GAS 


-0.45** 


-0.27* -0.44** 


-0.36** 


-0.46** 


-0.44** 


-0.34** -0.30* 


-0.47** 



*p<0.01, **p<0.001. (1): family relationship, (2): teacher relationship, (3): Peer relationship, (4): academic achievement, CAFIS: child and ado- 
lescent functioning impairment scale, C-GAS: chUdrens global assessment scale 



Table 5. Differences in mean scores of the subscales of CAFIS between ADHD and normal control groups 







ADHD (N=72) 




Normal controls (N=42) 






Mean 


SD 


Mean 


SD 


t 


CAFIS-parent form 


(1) 


6.1 


6.1 


2.2 


3.5 


4.39** 




(2) 


2.0 


2.3 


0.5 


1.2 


4.58** 




(3) 


2.6 


3.0 


0.8 


1.5 


4.26** 




(4) 


3.4 


2.3 


1.4 


2.0 


4.73** 


CAFIS-teacher form 


(2) 


1.9 


2.6 


0.6 


1.6 


3.70* 




(3) 


5.7 


5.2 


2.1 


3.3 


4.50** 




(4) 


3.5 


2.4 


1.4 


2.2 


4.72** 



*p<0.01, **p<0.001. (1): family relationship, (2): teacher relationship, (3): Peer relationship, (4): academic achievement, ADHD: attention- 
deiicit/hyperactivity disorder, CAFIS: child and adolescent functioning impairment scale, SD: suicidal depression 



The residts of this study show that the CAFIS has sound psy- 
chometric properties. The CAFIS is reliable and valid for the 
diagnosis of children and adolescents with ADHD. The inter- 
nal consistency of total and subscale scores of the parent and 
teacher forms were satisfactory comparable to other impair- 
ment scales such as CAFAS (0.63 to 0.68) or BIS (0.56 to 0.88). 
The test-retest reliability at a 4 week interval was also satisfac- 
tory comparable to those of CAFAS (0.77) and CAPA Inca- 
pacity rating (0.76). 

The CAFIS has shown to have satisfactory construct validi- 
ty as well. The parent form comprised of four factors that are 
family, teacher, and peer relationship and academic achieve- 
ment. The teacher form comprises identical factors to the par- 
ent form except for the inclusion of the family relationship fac- 
tor. Factor analysis was not performed on the CAPA Incapacity 
ratings and the DISC-IV Impairment measures. We can say 
that the CAFIS is more valid for construct validity than the 
two scales. In addition, all subscales included the item related 
to the requirement to treatment (or treatment-seeking), except 
for the subscale for peer relationship indicating that this item 
is necessary when measuring the impairment of social or aca- 



demic functioning. Using the C-GAS, concurrent validity was 
verified. Compared to the result of BIS study, the correlations 
between CAFIS and C-GAS were smaller than those between 
BIS and C-GAS (-0.45 to -0.60). However, since both the BIS 
and C-GAS measure children's functioning independently of 
symptomatology and whereas the CAFIS is a symptom-specif- 
ic scale, the results do not threaten the concurrent validity of 
the CAFIS. In our study, both parent (-0.46) and teacher 
(-0.47) rated impairment on academic achievement was high- 
ly correlated with the C-GAS. This indicates that academic 
functioning of children is an important factor affecting global 
functioning perceived by the parents and teachers. In addition, 
the CAFIS shows good discriminant validity. The ADHD 
group had higher scores on all subscales of CAFIS-parent and 
CAFIS-teacher form in comparison to those of normal con- 
trols. In particular, the mean score of the academic achieve- 
ment subscale was highest for the ADHD group and the dif- 
ference in the subscale scores of academic achievement 
between the two groups was greatest. 

In the ROC analyses, we found that the CAFIS could discri- 
minate ADHD from normal children. In CAFIS-parent form, 
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Table 6. Results of ROC analyses on CAFIS 











CAFIS-parent form 












CAFIS-teacher form 








Total 


(1) 




(2) 




(3) 




(4) 


Total 




(2) 


(3) 




(4) 


AUG 


0.81 


** 


0.71 


** 


0.71** 


0.69* 


0.77** 


0.79 




0.65* 


0.73 


** 


0.78** 


cutoff 


Sen 


Spe 


Sen 


Spe 


Sen 


Spe 


Sen 


Spe 


Sen 


Spe 


Sen 


Spe 


Sen 


Spe 


Sen 


Spe 


Sen 


Spe 


score 






































1 


0.96 


0.10 


0.82 


0.31 


0.61 


0.76 


0.64 


0.67 


0.92 


0.50 


0.97 


0.31 


0.54 


0.72 


0.85 


0.43 


0.92 


0.60 


2 


0.92 


0.26 


0.74 


0.55 


0.50 


0.88 


0.54 


0.81 


0.71 


0.67 


0.94 


0.41 


0.37 


0.83 


0.72 


0.55 


0.76 


0.67 


3 


0.89 


0.41 


0.60 


0.74 


0.31 


0.93 


0.43 


0.86 


0.63 


0.79 


0.89 


0.45 


0.27 


0.88 


0.63 


0.67 


0.58 


0.79 


4 


0.86 


0.57 


0.49 


0.83 


0.23 


0.93 


0.28 


0.88 


0.47 


0.88 


0.79 


0.52 


0.25 


0.98 


0.51 


0.76 


0.43 


0.86 


5 


0.83 


0.69 


0.47 


0.91 


0.17 


0.98 


0.19 


1.00 


0.29 


0.91 


0.76 


0.62 


0.17 


1.00 


0.49 


0.88 


0.35 


0.86 


6 


0.81 


0.79 


0.46 


0.93 


0.13 


1.00 


0.11 


1.00 


0.21 


0.93 


0.68 


0.69 


0.14 


1.00 


0.43 


0.95 


0.31 


0.91 


7 


0.75 


0.83 


0.39 


0.95 


0.04 


1.00 


0.08 


1.00 


0.10 


0.98 


0.65 


0.79 


0.07 


1.00 


0.38 


0.95 


0.15 


0.93 


8 


0.69 


0.83 


0.29 


0.95 


0.03 


1.00 


0.06 


1.00 


0.07 


0.98 


0.61 


0.86 


0.06 


1.00 


0.33 


0.98 


0.04 


1.00 



*p<0.01, **p<0.001. AUG: areas under the curve, CAFIS: child and adolescent functioning impairment scale, ROC: relative operating character- 
istics, (1): family relationship, (2): teacher relationship, (3): Peer relationship, (4): academic achievement. Sen: sensitivity, Spe: specificity, 0.9-1: 
excellent, 0.8-0.9: very good, 0.7-0.8: good, 0.6-0.7: average, 0.5-0.6: poor 



ROC Curve 




0.0 I Y- ^ ^ ^ ^ 

0.0 0.2 0.4 0.6 0.8 1.0 

1-Specificity 



Figure 1. ROC curves for total score of CAFIS-parent and CAFIS- 
teacher forms. ROC: relative operating characteristics, CAFIS: child 
and adolescent functioning impairment scale. 

AUG of total score w?as at an excellent level (0.8-0.9)^' and most 
of AUCs fell into acceptable level (0.7-0.8), except the peer re- 
lationships subscale. In CAFIS-teacher form, most of AUCs were 
at an acceptable level (0.7-0.8), except the teacher relationships 
subscale. In particular, for both the parent and teacher forms of 
CAFIS, the AUCs for the academic achievement subscale were 
higher than those of other subscales. 

For a scale with a diagnostic purpose, increased specificity is 
desirable at the price of decreased sensitivity in order to de- 
crease the number of false positive cases. Since the CAFIS was 
intended to get utilized in the diagnostic process of ADHD, 
the optimal cutoff score was determined first with high speci- 
ficity, and second, balanced sensitivity with specificity. On the 
basis of these criteria, the optimal cut-off score of the CAFIS- 
parent form was 7 for total score (sensitivity: 0.75; specificity: 



0.83), 3 for the family relationship subscale (sensitivity: 0.60; 
specificity: 0.74), 1 for the teacher relationship subscale (sensi- 
tivity: 0.61; specificity: 0.76), 1 for the peer relationship subscale 
(sensitivity: 0.64; specificity: 0.67), and 3 for the academic 
achievement subscale (sensitivity: 0.63; specificity: 0.79). In the 
CAFIS-teacher form, optimal cut-off scores were 6 for total 
score (sensitivity: 0.68; specificity: 0.69), 1 for the teacher rela- 
tionship subscale (sensitivity: 0.54; specificity: 0.72), 3 for the 
peer relationship subscale (sensitivity: 0.63; specificity: 0.67), 
and 3 for the academic achievement subscale (sensitivity: 0.58; 
specificity: 0.79). For both, the parent and teacher forms of 
CAFIS scale, AUC and the sensitivity and specificity of all sub- 
scales were relatively low in comparison to those of the total 
scores of each scale. Possible explanation for these results would 
be that individual subscale of the CAFIS does not serve for the 
functioning impairment per se to determine the caseness of 
ADHD. Instead, impairment in several functional areas to- 
gether as a whole would fit for the impairment criteria de- 
scribed in the DSM system. Based on the results of ROC anal- 
ysis, the value of AUC and the sensitivity and specificity of aca- 
demic functioning again was highest among other subscales, 
indicating that academic achievement is an important factor 
to be considered in the diagnosis of ADHD in our sample. 

There are some limitations of this study. Though the CAFIS 
instruct parents and teachers to rate chUdreris impairment due 
to inattentiveness, hyperactivity or impulsivity, confounding of 
functioning by symptomatology cannot be excluded complete- 
ly. Further, impairment due to psychiatric symptoms other 
than the ADHD symptoms cannot be easily distinguished by 
the raters. Especially, functional impairment in relevance to 
children's developmental disabilities and comorbidities is an 
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issue to be addressed further. In this study, we excluded chil- 
dren with previous and current development disorders, and 
further excluded children with lower intelligence by adminis- 
tering standardized intelligence tests. Impairment in ADHD 
children having comorbid psychiatric disorders were not con- 
sidered separately in this study, though the comorbidities obvi- 
ously would impact the fimction in children and may drive rat- 
ings of impairment more than does ADHD itself The reason 
why we did not compare functional impairment in ADHD 
children with comorbidities to compare that of children with- 
out comorbidities, because the percentage of children with co- 
morbidities in our study were relatively low, and thus, the sam- 
ple size was too small in comparison to previous studies.™ 
Because of the restriction of enrollment into the study and co- 
morbid features of our sample, generalization of the results to 
ADHD samples in general practice could be decreased. There 
is another issue of cultural variation. Although the questions in 
the scales were formulated generally as such, "is there problems 
in. . ." or "need the child intervention or treatment because of 
. . .", these scales still need to be evaluated in more culturally di- 
verse samples. In addition, a nationally representative norma- 
tive data should be provided in order to get broadly used in 
clinical, research, and administrative applications. 

In conclusion, the CAFIS is a newly developed, brief respon- 
dent-based, and easily administered scale for measuring fiinc- 
tional impairment in children and adolescents. The parent and 
teacher versions which are nearly identical in format and con- 
tent will allow comparison of parents' and teachers' perceptions 
as to the chUdreris functional impairment. The scale has satis- 
factory levels of reliability and validity, and appears to be valu- 
able in differentiation of children with and without ADHD. Al- 
though the psychometric properties of this scale have shown 
to be satisfactory, the CAFIS needs to be verified further with 
other scales in which the interviewer makes a clinical judg- 
ment about the rating in order to be used for the diagnostic 
purpose. When age and gender-specific normative data is pro- 
vided in the future, these scales will not only assist in ADHD 
identification but also promote planning and monitoring ef- 
fective management of children with ADHD. 
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